Papers with WMT’14 En-De
Multi-split Reversible Transformers Can Enhance Neural Machine Translation (2021.eacl-main)
Copied to clipboard
| Challenge: | Large-scale transformers have been shown to improve neural machine translation performance but training these wider and deeper networks could be extremely memory intensive. |
| Approach: | They propose a multi-split based reversible transformer and a backpropagation algorithm that does not need to store activations for most layers. |
| Outcome: | The proposed model outperforms the vanilla transformer by at least 1.4 BLEU points in three datasets. |
MR-P: A Parallel Decoding Algorithm for Iterative Refinement Non-Autoregressive Translation (2022.findings-acl)
Copied to clipboard
| Challenge: | Non-autoregressive neural machine translation models remove dependency between tokens in the target sentence and generate all tokens on parallel . |
| Approach: | They propose a non-autoregressive neural machine translation model that decodes with the Mask-Predict algorithm which iteratively refines the output. |
| Outcome: | The proposed algorithm increases the performance of the WMT’14 translation task by 1.39 points. |